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ABSTRACT 



This executive summary presents evaluation findings and 
conclusions from a 4 -year study of a demonstration project focusing on a 
school -based and school -linked interprofessional case management approach to 
dropout prevention. The project, funded by the U.S. Department of Education, 
was administered by the Center for the Study and Teaching of At-Risk Students 
(C- STARS) at the University of Washington and Washington State University. 
During the project, a generic model for interprofessional case management was 
introduced in 5 school districts (28 schools) . The model consisted of a set 
of guidelines for site- tailored delivery of case management services, and it 
included an evaluation component to assess outcomes. Each district targeted 
case management services in consideration of its unique demographic and 
service need priorities. An inner-city district, a suburban district, and 
districts with high numbers of American Indians, Hispanic American students, 
and low- income rural students participated. An analysis of attendance, 
academic grade, and misconduct data revealed that students who met the 
C-STARS criteria generally improved in these areas while receiving case 
management services. Over the 4 years there were measurable improvements in 
all three areas, and there was an increase in progress toward or attainment 
of service goals each of the last 3 years of the project. Factors that 
contributed to effective case management were identified, and it was also 
found that the involvement of teachers and family members in the case 
management process was essential. Overall, findings demonstrate that 
school -based interprofessional case management as demonstrated at these sites 
is a viable means of addressing problems of at-risk students and their 
families. (SLD) 
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Washington State Coordinated Service Initiative for At-Risk Youth and Families 

Executive Summary 



Background and Introduction 

This report presents evaluation findings and conclusions from a four-year (1991-95) study of a 
demonstration project focusing on a school-based and -linked interprofessional case management 
approach to dropout prevention. This demonstration was funded by the US Department of Education's 
Dropout Demonstration Assistance Program (Grant No. S201C12560). The demonstration project was 
administered by the Center for the Study and Teaching of At-Risk Students (C-STARS), co-housed in 
the College of Education at the University of Washington in Seattle and Washington State University in 
Pullman. 

During the duration of the project, a generic model for interprofessional case management was 
introduced in five very different Washington State school districts to 28 pre/K-12 schools including an 
alternative secondary school. Each district and/or its individual case management teams developed and 
implemented its unique site-based adaptation of this generic model through the four years of the 
demonstration. 

The case management model being demonstrated consists of a set of guidelines for site-tailored delivery 
of case management services. These guidelines include an operational definition for case management 
that is multi-disciplinary in orientation, a set of seven interrelated functions corresponding to the 
definition, and a structural framework for delivery of case management services. The model also 
includes an evaluation component designed to (1) assess outcomes to students and their families who 
participate with these case management activities and (2) assess the efficacy of the process(es) used for 
delivery of these site-specific variations of this case management model. v 

Each of the five participating school district-communities chose to target case management services in 
consideration of its unique demographic and service need priorities. Participating in the project were (1) 
an inner city area adjacent to two large military bases located near Tacoma; (2) a district in Western 
Washington including a moderately sized tribal reservation; (3) a district in Southeastern Washington 
serving high numbers of migrant Hispanic farmworker students and families; (4) a remote area of a 
geographically large district, located in a rural isolated and economically depressed area approximately 
fifty miles west of Tacoma; and (5) a suburban school district located near Spokane. Each of these 
school districts reported annual dropout rates far in excess of state averages over a five-year period 
(Office of the State Superintendent of Public Instruction, 1990). 

At the beginning of the project, each school district was asked to form case management teams and 
identify who would be designated to act as case managers. C-STARS project staff then introduced each 
team or cluster of teams to the generic guidelines for interprofessional case management along with the 
evaluation design. Each team subsequently developed and began field-testing its site-specific variation 
of the generic model. From 1991 to 1995, full case management services were activated with 934 
students and their families. Approximately 7,000 additional children and their families received short 
term or one time only services. 
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Evaluation Highlights 



Both qualitative and quantitative evaluation methodologies were used throughout the study including 
end of year reports, surveys, focus group consultations, key informant interviews, reviews of student 
files, and reviews of service plans. 

An outcome evaluation component attempted to determine whether student outcomes specific to 
attendance, grades and/or classroom behavior could be attributed to or associated with case 
management activities. These indices were selected based on a poll of case managers, team members, 
and school administrators from previous C-STARS sites, as well as a review of the literature. The 
following "benchmarks" were used to identify students who were considered to be "at-risk" in these 
areas: Absences - 10% or more days missed within a reporting period; b) Academic Grades - 10% or 
more low or failing grades on academic subjects within a reporting period; Misconduct - One or more 
conduct referrals to the school office within a reporting period, including suspensions. 

The primary questions addressed with this evaluation component were: 

1. Do students targeted for case management services because of attendance concerns show significant 
improvement in attendance? 

2. Do students targeted for case management because of low grades show significant improvements in 
academic performance? 

3. Do students targeted for case management because of classroom behavior concerns show significant 
improvements in classroom behavior? 

The methodology used to address and answer these questions consisted of analyzing baseline to end-of- 
year changes, referencing data collected at regular intervals (e.g., quarter, semester). In addition, 
correlation and inferential analyses were used to note any associations between these indices and specific 
service interventions. 

A process evaluation component attempted to provide evidence of "best case management practice" 
from perspectives of families and children, the different service providers working on or with teams and 
the policy makers and administrators of the different service systems that participated with the project. 
This component addressed the “what”, "how" and "why" aspects of the case management programs. 

This was intended to help determine what lessons case management team members learned from their 
experience, and also how the program was perceived by other school staff, family members, and outside 
agency personnel. 

Questions addressing this evaluation component included: 

Who assumed case manager roles and responsibilities as members of these case management teams? 

How many students and their families did case management teams work with? 

To what extent are goals listed in individual service plans accomplished? 
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4, What differences in case management functions and structure may be discerned from successful and 
unsuccessful case management experiences? 

5, Does the active involvement of teachers with case management teams contribute to successful case 
management? 

6 , Does the active involvement of parents with case management teams contribute to successful case 
management? 

The methodology used to address and answer these questions consisted of an analysis of se ™“ p '‘j n 
components induding a) risk indicators, b) goals set, c) planned actions steps, d) progress reported, e) 
“Tms hck of pfogress reported, and f) follow-up steps taken. The frequency and types of 
activities reported under these categories were examined at regular intervals, usmg P r0 ^ es ^°" 
update protocols. The correspondences between service functions and outcomes reported 

examined. 

A "lessons learned" component was added during the 1994-95 school year to further ^describe die 
intentions and consequences of case managers, their teams, and their progn uns . Thu ‘ C °™P° 
attempted to docum^it a) what lessons case management team metnbers leaded *on 
“ring a modified critical incident procedure called the Critical Case Review (CCR^db) how the 
program is perceived by other school staff, family members, and outside agency personnel (re., 
stakeholders). Each team identified a successful case and a less than successful case - * l d 
examination of each facilitated by C-STARS personnel. Surveys and focus group consultations were 

used for this process. 



A Summary of Findings 

An analysis of attendance, academic grade, and misconduct data revealed ^ 

STARS criteria generally improved in these areas while receiving case man g 
improvement was statistically significant. A summary is as follows: 

Absences - There were measurable improvements in all four years. These improvements were 
Absences mere reduction in absenteeism occurred during the 

statistically significant in three ot the tour years. Migm icuuvt y , QQ4 Q( - h i 

fim vear of the project in which some school sites were still "tooling up." Across the 1994-95 schoo 
first year oi me prujcn vviuv r 5T *pc ride rriterinn for absenteeism dropped from 21 

year, the percentage of stu ents j™ 5 ® mg * g4 < 005 ) This tren d was a continuation from previous 
to 14, a proportional improvement of .33 P^ uudj. mis 1007.93 

years, wfth proportional reductions of .14 <*-1.10, n.s.) in 1991-92, .39 (*=3.53, p<.001) in 1992 93, 

and .47 ( t= 5.09, p< .000) in 1993-94. 

Low Grades - There were measurable improvements in all four years. 

(^gS^^D'^^sCforompl^s^^o^rtOTcy^^^gr^ng s^tem^were less dramatic, albeit m the 
(e.g., t s, u s, u s lncumpicic f j , , : t w j th proportional improvements 

^“ 0 “ 20 in 1994-95 ^52, p<,l). 

improvement was . 10 (*-l .49, n.s.), and 1992-93 proportional improvement was . 16 (*=2.61, p .01). 



most substantial proportionate gains, ranging from .28 in the 1992 93 scnoo y t 

r h °1 9 94-95 school year (1-6 74, p< .000). Other proportional tmprovements included .53 (r-3.86, p 

.000) in 1993-94 and .62 (*=5.02, p< .000) in 1991-92. 



Other Findings 

. Case Managers: Most districts employed full-time case managers. However, two utthzed 

Tate r«tc re as^^»^^n ' 

housed in central offices and had less direct contact with the targeted students and 

About Case Loads: Depending on whether the case manager or counselor devoted foil or P* rt t0 
f . C STARS students and families foil service caseloads ranged from 8 students and families ( • 

‘L devoid) “dented families (100% time devoted). It was gener^ya^thm a full- 
time case manager could be expected to service an average case load ranging fro 8 

children and their families. In addition, there were widely varying numbers of short-te 

students reported. 

| ntr °^ i0n " ^ 

three of CAPAS software, which replaced most previously used data gathering instru 

About Case Management Practices: Factors that case managers ones 

contributing to successful case management were also docu - . service Whin the regular 

included' 1) Interprofessional case management must be treate g achieved- 3"! The 

school mogram- 2) A balanced school/family/community service orientation must be achieved 3 > The 

d "o^ign exisfing personnel or hire non-schoo, be 



teacher. Case managers also reported higher frequencies of parental involvement with successful case 
management experiences. 

Correlational and inferential analyses showed that case “ t ™^f Sch c^ WUle the * 

in common by case managers or teams and behavior problem interventions associated with 
some trends toward categones of fami y r- . l . ... 0 f these concerns. This was 

positive changes in attendance and conduct f •****£• I ^emsVahstically significant 

observed primarily with primary-age students. For example behavior (r- .47, p<.02), and 

correlations between progress on goals and academic (r - .48, p< .02), behavior t F 

family (r = .43, p< .04) activity groupings. 

Conclusions and Recommendations 

C-STARS' findings suggest that school-based interprofess^ fvTble 

characteristics associated with families. 

Students who me. initial benchmarks and ^7^“ 

three primary risk indicators - attendance, S™d«, condu «- stowed mmked J improverae „, 
goals met) of case management increased in the latter years o e p j 

Interventions with families played a major role in of 

members. 

Conclusions and Caveats Addressing This Evaluation 
school-linked comprehensive services. These include. 

. The complexity and flexibility of these programs make it difficult to adequately identify and 
characterize the independent variables of interest. 

• The difficulty in assessing quality and degree of collaboration. 
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• The interdisciplinary nature of these endeavors involving researchers from different fields who rarely 
communicate with each other (Kagan, 1991; Knapp, 1994). 

• The difficulty in studying impacts of contextual factors, particularly cultural factors, on the processes 
and outcomes of these interventions. 

• Ways to conduct evaluations that are appropriate and congruent with the culture of the community 
in which services are located. 

• The difficulty of identifying and developing evaluators who understand and operate sensitively in 
different cultural settings. 
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